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Abstract — As remote sensing images can be used to identify 
features and interpret ground conditions, they have been widely 
used in many fields from environment resources investigation to 
military operation. However, most of the remote sensing images 
have little visual contrast and poor resolution. Thus, the remote 
sensing image enhancement technique is almost always applied 
before the remote sensing images are analyzed. Numerous image 
enhancement techniques are available. In this study, a novel 
image enhancement technique, Multi-scale Retinex (MSR), is 
introduced. This enhancement technique is effective especially for 
images with poor visibility or low resolution. In this study, several 
classic image enhancement techniques, say, histogram 
equalization, are also introduced. To illustrate the effectiveness 
and superiority of the MSR technique on remote sensing image 
enhancement, the technique is compared with these classic 
enhancement techniques by enhancing a remote sensing image 
with poor visibility and little visual contrast. The results show 
that MSR technique is satisfying and superior over the other 
enhancement techniques. 
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I. Introduction 

Remote sensing sensor systems detect reflected or emitted 
radiation from features on the earth's surface. Usually, the 
detected energy does not fill the entire gray level range the 
sensor is capable of. So, most of the remote sensing images 
have little visual contrast and poor resolution. Therefore, 
remote sensing image enhancement occupies a peculiar 
position in remote sensing image processing and is an 
important preprocessing step for subsequent analysis. By now, 
numerous image enhancement techniques have been proposed. 
One way to enhance the remote sensing image is to 
redistribute the image gray levels to fill the entire range of the 
display medium. There are linear and non-linear contrast 
enhancement techniques. However the effectiveness of these 
techniques is very limited. Another classic enhancement 
technique is histogram equalization. This technique works 
well for most of the images, but not so well for images with 
very dark and very bright areas at the same time. In this study, 
the MSR algorithm is introduced to solve this problem and 
enhance the remote sensing image effectively. 

The idea of the retinex was conceived by Edwin Land [1] as 
a model of the lightness and color perception of the human 
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vision. Through the years, Land [2][3] evolved the concept from 
a random walk computation to its last form as a 
center/surround spatially opponent operation which is related 
to the neurophysiological functions of individual neurons in 
the primate retina, lateral geniculate nucleus, and cerebral 
cortex. Subsequently Hurlbert [4][5] studied the properties of 
this form of retinex and other lightness theories and found a 
common mathematical foundation, which possesses some 
excellent properties but cannot actually compute reflectance 
for arbitrary scenes. Basic study of the properties of the 
center/surround retinex led us in the direction of using 
Gaussian surround used by Hurlbert as opposed to the 
exponential surround used by Moore [6] for analog VLSI 
resistive networks. Based on this idea the Single-scale 
Retinex (SSR) is developed and subsequently the Multi-scale 
Retinex (MSR) is developed by Jobson, et al [7][8] . 

In the course of our experiments, this technique is compared 
with several other image enhancement techniques to 
demonstrate its usefulness and effectiveness for enhancing 
remote sensing images. 



II. 



Image enhancement techniques 



2.1 Linear Stretch 

One of the most common methods of enhancing an image is 
the application of a linear stretch technique to stretch the 
dynamic range of the image. This is a linear operation and 
matches the image's dynamic range to the dynamic range of 
the display medium. Thus, it allows for a greater contrast 
between features and can lead to a more accurate 
interpretation of features within the image. However, it has 
limited success on scenes that encompass a much wider 
dynamic range than that can be displayed. In this case, loss of 
detail occurs due to saturation and clipping as well as due to 
poor visibility in dark regions of the image. For an image with 
dynamic range between r min and r max , and a display medium 

with dynamic range d max , this transform can be represented 
by 



Hx,y): 



[nx,y)-r mm ] 



(1) 



where I(x,y) denotes the intensity of the original image, 
and / (x, y) denotes the intensity of the enhanced image. This 



particular transform will transform the image to completely 
fill the dynamic medium. This does not imply, however, that 
this process will provide a good visual representation of the 
original image. The modification of the histogram distribution 
is used to illustrate the effect of this technique, see Fig.l (a). 

2.2 Non-linear Transform 

Another well-known method used for providing dynamic 
range compression or stretch is the application of non-linear 
transforms, such as the gamma non-linearity, the logarithm 
function, and the power-law function, to the original image. 
These functions are typically biased toward increasing the 
'visibility' in the 'dark' regions by sacrificing the visibility in 
the 'bright' areas. The output of such filters can be described 
by 

l\x,y) = T[l(x,y)] (2) 

where T[] represents the non-linear transform. A typical 

non-linear transform is 

/'(jc,v) = /(jc,v) log(fl)/log(a5) (3) 

where a denotes a parameter used to control the transform 

function, I(x, y) denotes the intensity of the original image, 

and / (x, y) denotes the intensity of the enhanced image. The 
transform curves with different a values are shown in Fig.l 
(b). 

2.3 Histogram Equalization 

A global technique that works well for a wide variety of 
images is histogram equalization. This technique is based on 
the idea of remapping the histogram of the scene to a 
histogram that has a near-uniform probability density function. 
This results in reassigning dark regions to brighter values and 
bright regions to dark values. Histogram equalization works 
well for scenes that have unimodal or weakly bi-modal 
histograms, but not so well for those images with strongly bi- 
modal histograms. The modification of the histogram 
distribution is used to illustrate the effect of this technique, see 
Fig.l (c). 

2.4 Multi-scale Retinex 

The single-scale retinex (SSR) is given by 

R(x, y) = log I(x, y) - log [F(x, y) * I(x, y)] (4) 

where R(x, y) is the retinex output, I(x, y) is the image to 

be enhanced, "*" denotes the convolution operation, and 

F(x, y) is the surround function, 

F(x,y) = Kexp[-(x 2 +y 2 )/cj 2 ] (5) 

where G is the Gaussian surround space constant, or the 
scale, and K is selected such that 

j]>(x, y)dxdy = 1 (6) 

The MSR output is simply the weighted sum of the outputs 
of several SSRs with different scales. 
Mathematically, 

*m (*, 30 = 2>„ • { lo g U(x> 30] - log [/(*, 30 * K (*. 30]} (7) 



image, R M (x,y) is the output of the MSR process, F n (x,y) 
represents the nth surround function, w n are the weights 
associated with F n (x,y), and "*" represents the convolution 
operator. The surround functions F n (x, y) are given as: 

F n (x,y) = K n exp [-(x 2 + y 2 )/a 2 n ] (8) 

where o n is the standard deviation of the ftth surround 
function, and K n is selected such that: 

j]X exp [-(x 2 + y 2 )/a 2 n }lxdy = 1 (9) 

The MSR is superior obviously to the SSR in combination 
of scales [9] , which provide both dynamic range adjustment and 
tonal rendition at the same time. For color images, every 
spectral band of the color image should be applied to the 
techniques. 
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Fig 1. The characteristics of the enhancement techniques, (a) 
The modification of the histogram distribution when using 
linear stretch, (b) The transform curves with different a 
values when using non-linear transform, (c) The modification 
of the histogram distribution when using histogram 
equalization. 



MSR IMPLEMENT 

the MSR is implemented 



III. 

As stated above, tne MSK is implemented using 
convolution operation and performing this operation in the 
spatial domain is extremely time-consuming. In order to make 
the MSR technique a real-time technique, the convolution 
theorem is used to convert the convolution operation in spatial 
domain to multiplication in the spatial-frequency domain [10][11] 



where N is the number of scales and I(x, y) is the input 



f(x 9 y) * g(x, y) <=> FQi,v)G(ji,v) (10) 

where F(ju,v) and G(ju,v) are the spatial frequency 
domain representations of f(x,y) and g(x,y) respectively. 
The author employs the 2-dimensional MxN forward and 
inverse Discrete Fourier Transforms (DFT) [11] 

i M-lN-l 

F(M>v) = ^^TsTsf( x >y) ex v[-J 2; r(Mx/M+vy/N)](n) 

MNt^ o p o 

M-lN-l 

fix, y) = X E F(M,v)e*p[j2x(Mx/M + vy/N)] (12) 

ju=Q v=0 

Then the MSR can be rewritten as 
^Mte^) = i^-{log[/tev)]-log[F-H/'(//,v)F;(//,v))]} (13) 

where l\ju,v) and F n (jU,v) represent the DFTs of 
I(x,y) and F n (x,y) respectively, and F~ l represents the 

inverse DFT. The DFT can be computed with Fast Fourier 
Transform (FFT), and the 2-dimensional transforms can be 
computed by applying 1 -dimensional FFTs to the rows and 
columns of the image. 



IV. 



Experimental Results 



Although the techniques introduced in this study can be 
used to enhance images, as discussed above, the MSR 
technique is more suitable for enhancing remote sensing 
images. To demonstrate the effectiveness of the MSR 
technique and its superiority over the other techniques on 
enhancing remote sensing images, a remote sensing image 
enhancement experiment is conducted using these 
enhancement techniques respectively. The original image 
(Fig. 2 (a)) is a typical remote sensing image with poor 
visibility and little visual contrast. Fig. 2 (b), Fig. 2 (c), Fig. 2 (d) 
and Fig. 2 (e) are the enhanced images from linear stretch, non- 
linear transform, histogram equalization and MSR respectively. 
The experiment demonstrates that the effectiveness of the non- 
linear transform is very limited, the linear stretch enhance the 
image but not good enough, the histogram equalization 
improve the visibility in the dark areas with the cost of low 
visual contrast in the bright areas, and the MSR yields a 
satisfying enhanced image. 



V. 



CONCLUSIONS AND DISCUSSIONS 



In this research, the remote sensing image enhancement is 
discussed and several enhancement techniques are introduced. 
However, most of the remote sensing images always have 
poor visual contrast and poor resolution. Therefore, some of 
the enhancement techniques may lose their competence for 
enhancing this kind of images. According to the characteristics 
of the remote sensing images, the MSR technique is 
introduced. And the effectiveness and its superiority over other 
techniques are also demonstrated by an experiment. 
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(e) 
Fig 2. Remote sensing image enhancement using the 
enhancement techniques introduced in this study, (a) The 
original remote sensing image, (b) The enhanced image from 
linear stretch, (c) The enhanced image from non-linear 
transform, (d) The enhanced image from histogram 
equalization, (e) The enhanced image from MSR. 



